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Abstract 

In this paper we study the parameterized complexity of two well-known 
permutation group problems which are NP-complete. 

• Given a permutation group G = (S) < S n and a parameter k, find 
a permutation ir € G such that \{i <E [n] \ ir(i) ^ i}\ > k. This 
generalizes the NP-complete problem of finding a fixed-point free 
permutation in G [CW101 ILub81] (this is the case when k = n). 
We show that this problem with parameter k is fixed parameter 
tractable. In the process, we give a simple deterministic polynomial- 
time algorithm for finding a fixed point free element in a transitive 
permutation group, answering an open question of Cameron [C1H 
ICW10] . 

• Next we consider the problem of computing a base for a permutation 
group G = (S) < S n . A base for G is a subset B C [n] such that 
the subgroup of G that fixes B pointwise is trivial. This problem 
is known to be NP-complctc [B192] . We show that it is fixed pa- 
rameter tractable for the case of cyclic permutation groups and for 
permutation groups of constant orbit size. For more general classes 
of permutation groups we do not know whether the problem is in 
FPT or is W[l]-hard. 



1 Introduction 

Let S n denote the group of all permutations on a set of size n. The group S n 
is also called the symmetric group of degree n. We refer to a subgroup G of 
S n , denoted by G < S n , as a permutation group (of degree n). Let S C S n 
be a subset of permutations. The permutation group generated by S, denoted 
by (S), is the smallest subgroup of S n containing S. A subset S C G of a 
permutation group G is a generating set for G if G = (S). It is easy to see that 
every finite group G has a generating set of size log 2 |G|. 

Let G = (S) < S n be a subgroup of the symmetric group S n , where G is 
given as input by a generating set S of permutations. There are many algorith- 
mic problems on permutation groups that are given as input by their generating 
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sets (e.g. see |Sim70l IFHL801 ILuk931 ISer03j ). Some of them have efficient al- 
gorithms, some others are NP-complete, and yet others have a status similar 
to Graph Isomorphism: they are neither known to be in polynomial time and 
unlikely to be NP-complete (unless the Polynomial-Time Hierarchy collapses). 
Efficient permutation group algorithms have played an important role in the de- 
sign of algorithms for the Graph Isomorphism problem [Bab79l IBKL83] . In fact 
the algorithm with the best running time bound for general Graph Isomorphism 
is group-theoretic. 

We recall some definitions and notions from permutation group theory. Let 
7r £ S n be a permutation. A fixed point of ir is a point i € [n] such that ir(i) = i 
and 7r is fixed point free if 7r(i) ^ i for all i G [n]. 

Let G < S n and A C [n] be a subset of the domain. The pointwise stabilizer 
subgroup of G, denoted Ga, is {g € G \ g(i) = i for all i € A}. 

A subset B C [n] is called a base for G if the pointwise stabilizer subgroup 
Gb is trivial. Thus, if B is a base for G then each element of G is uniquely 
determined by its action on B. The problem of computing a base of minimum 
cardinality is known to be computationally very useful. Important algorithmic 
problems on permutation groups, like membership testing, have nearly linear 
time algorithms in the case of small-base groups (e.g. see |Ser03| ). We will dis- 
cuss the parameterized complexity of the minimum base problem in Section [3j 

An excellent modern reference on permutation groups is Cameron's book 
|C99| . Algorithmic permutation group problems are very well treated in |Luk93[ 
ISer03j . Basic definitions and results on parameterized complexity can be found 
in Downey and Fellows' classic text on the subject |DF99j . Another, more 
recent, reference is |FG06j . 

2 Fixed point free elements 

The starting point is the Orbit-Counting lemma. Our discussion will follow 
Cameron's book |C99j . For each permutation g E S n let fix(g) denote the 
number of points fixed by g. More precisely, 



A permutation group G < S n induces, by its action an equivalence relation 
on the domain [n]: i and j are in the same equivalence class if g(i) = j for some 
g € G. Each equivalence class is an orbit of G. G is said to be transitive if 
there is exactly one G-orbit. Let orb(G) denote the number of G-orbits in the 
domain [n]. We recall the statement. 

Lemma 2.1 (Orbit Counting Lemma). |C92j Let G < S n be a permutation 
group. Then 



I.e. the number of G orbits is the average number of fixed points over all ele- 
ments of G. 



Zx(g) = \{ie[n)\g(i)=i}\. 




(1) 
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Proof. It is useful to recall a proof sketch. Define a |G| x n matrix with rows 
indexed by elements of G and columns by points in [n]. The {g,i) th entry is 
defined to be 1 if g(i) = i and otherwise. Clearly, the g th row has fix(g) many 
l's in it. Let Gi denote the subgroup of G that fixes i. The i th column clearly 
has \Gi\ many l's. Counting the number of l's in the rows and columns and 
equating them, keeping in mind that is the size of the orbit containing 

i yields the lemma. □ 

We now recall a theorem of Jordan on permutation groups [J72j . See 
[Se03l ICTTj for very interesting accounts of it. A permutation group G < S n is 
transitive if it has exactly one orbit. 

Theorem 2.2 (Jordan's theorem). If G < S n is transitive then G has a fixed 
point free element. 

It follows directly from the Orbit counting lemma. Notice that the left side 
of Equation [1] equals 1. The right side of the equation is the average over all 
fix(<7). Now, the identity element 1 fixes all n elements. Thus there is at least 
one element g £ G such that fix(g) = 0. Cameron and Cohen [C92j do a more 
careful counting and show the following strengthening. 

Theorem 2.3. [C92J If G < S n is transitive then there are at least \G\/n 
elements of G that are fixed point free. 

We discuss their proof, because we will build on it to obtain our results. If 
G is transitive, the orbit counting lemma implies 

\G\ = J2H9)- 

g&G 

Take any point a £ [n\. We can write the above equation as 

\G\ = £ fix( ff ) + fix (5). 

g€G a g£G\G a 

By the orbit counting lemma applied to the group G a we have 

^ fix(<7)=orb(G Q )-|Gy. 

g£G a 

Let F C G be the set of all fixed point free elements of G. Clearly, 
^2g&G\G a f^ x (5 r ) — |C\^I as A Q G \ G a and each element of G \ A fixes 
at least one element. Combining with the previous equation we get 

\A\ > ovb(G a ) ■ IGU = orb(G Q ) . M > M. 

n n 
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2.1 The Algorithmic Problem 



We now turn to the problem of computing a fixed point free element in a 
permutation group G < S n and a natural parameterized version. 

As observed by Cameron and Wu in |CW10j . the result of [C92j gives a 
simple randomized algorithm to find a fixed point free element in a transitive 
permutation group G < S n , where G is given by a generating set S: Using 
Schreier-Sims polynomial-time algorithm [Sim70| we can compute a strong gen- 
erating set S' for G in polynomial time. And using S' we can sample uniformly 
at random from G. Clearly, in 0{n) sampling trials we will succeed in finding 
a fixed point free element with constant probability. We will show in the next 
section that this algorithm can be derandomized to obtain a deterministic poly- 
nomial time algorithm (without using CFSG). This answers an open problem 
of Cameron discussed in |CW10t fCllj . 

This result is to be contrasted with the fact that computing fixed point free 
elements in nontransitive groups G < S n is NP-hard. The decision problem is 
shown NP-complete in |CW10j . This is quite similar to Lubiw's result |Lub81j 
that checking if a graph X has a fixed point free automorphism is NP-complete. 

We will now introduce the parameterized version of the problem of comput- 
ing fixed point free elements in permutation groups. First we introduce some 
terminology. We say that a permutation tt moves a point i S [n] if tt{i) ^ i. 

fe-MOVE Problem 

INPUT: A permutation group G = (S) < S n given by generators and a number 
k. 

PROBLEM: Is there an element g 6 G that moves at least k points. 

For k = n notice that k-MOVE is precisely the problem of checking if there 
is a fixed point free element in G. The parameterized version of the problem 
is to treat k as parameter. We will show that this problem is fixed parameter 
tractable. 

Let move(g) denote the number of points moved by g. We define two num- 
bers fix(G) and move(G): 



I.e. fix(G) is the number of points fixed by all of G and move(G) is the 
number of points moved by some element of G. Clearly, for all g £ G, move(g) = 
n — fix(g) and move(G) = n — fix(G). Furthermore, notice that orb(G) < 
fix(G) +move(G)/2, and we have n - orb(G) > move(G)/2. Let G = (S) < S n 
be an input instance for the fc-MOVE problem. Substituting n — move(g) for 



fix(G) 
move(G) 



\{i € [n] j g(i) = i for all g £ G}\ 
\{i G [n] | g{i) ^ i for some g G G}\ 
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fix(g) in Equation Q] and rearranging terms we obtain 



move(G)/2 < n — orb(G) = j— move(g) = E g6 G[move(g)] 



(2) 



g&G 



where the expectation is computed for g picked uniformly at random from G. 

We will show there is a deterministic polynomial time algorithm that on 
input G = {S} < S n outputs a permutation g € G such that move(g) > n — 
orb(G) > move(G)/2. Using this algorithm we will obtain an FPT algorithm for 
the /c-MOVE problem. We require the following useful lemma about computing 
the average number of points moved by uniformly distributed elements from a 
coset contained in S n . 

Lemma 2.4. Let Gir C S n be a coset of a permutation group G = (S) < S n , 
where ir £ S n . There is a deterministic algorithm that computes E 9g G[move(<?7r)] 
in time polynomial in \S\ and n. 

Proof. We again use a double counting argument. Define a 0-1 matrix with 
rows indexed by gir,g € G and columns by i £ [n], whose (gir,i) th entry is 1 if 
and only if g(ir(i)) ^ i. Thus, the number of l's in the i th column of the matrix 
is |G| — \{g 6 G | g(ir(i)) = Now, \{g £ G \ g(n(i)) = i}\ is zero if n(i) and i 
are in different G-orbits and is \Gi\ if they are in the same orbit. In polynomial 
time we can compute the orbits of G and check this condition. Also, the number 
|G| — \{g € G | g(n(i)) = i}\ = \G\ — \Gi\ is computable in polynomial time. Call 
this number iVj. It follows that the total number of l's in the matrix is Y2?=i 
which is computable in polynomial time. Since Y^7=i-Ni = S 3 eG move (fi ,7r )' ^ 
follows that j^jj YlgeG m ove(<77r) = E gg c[move(5'7r)] can be computed exactly in 
polynomial time. □ 

Theorem 2.5. There is a deterministic polynomial-time algorithm that takes as 
input a permutation group G = (S) < S n given by generators and a permutation 
tt G S n and computes an element g £ G such that vnove{gTi) > E 56 Gr[move(<?7r)]. 

Proof. We have 



and by Lemma [2l4l we can compute fi in polynomial time. We can write G as 
a disjoint union of cosets G = (Ji=i Gigt, where G\ is the subgroup of G that 
fixes 1 and g^ are the coset representatives, where the number of cosets r < n. 
Using Schreier-Sims algorithm |Sim70] we can compute all coset representatives 
gi and a generating set for G± from the input in polynomial time. 

Now, we can write the summation t^t ^ geG move(g7r) as a sum over the 
cosets Gigiir of G\: 




g&G 
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For 1 < i < r let 

Since |G|/|Gi| = r, it follows that M = f Ei = i M« i s an average of the mitj. Let 
lit denote maxi<j< r ^j. Clearly, [i < mu t and therefore there is some g E Gigtir 
such that move (g) > /xt > /x and we can continue the search in the coset Gig* 
since we can compute all the \i{ in polynomial time by Lemma [2. 4i Continuing 
thus for n — 1 steps, in polynomial time we will obtain a coset G n -iT containing 
the unique element r such that move(r) > fx. This completes the proof. □ 

Cameron, in |CW10] and in the lecture notes |Cllj . raises the question 
whether the randomized algorithm, based on uniform sampling, for finding a 
fixed point free element in a transitive permutation group (given by generators) 
can be derandomized. In |CW10j a deterministic algorithm (based on the clas- 
sification of finite simple groups) is outlined. The algorithm does a detailed case 
analysis based on the CFSG and is not easy to verify. Here we show that the 
randomized algorithm can be easily derandomized yielding a simple polynomial- 
time algorithm. The derandomization is essentially a simple application of the 
"method of conditional probabilities" [ES731 IRa88] . 

Corollary 2.6. Given a transitive permutation group G = (S) < S n by a 

generating set S, we can compute a fixed point free element ofG in deterministic 
polynomial time. 

Proof. Notice that E 5g G[move(<7)] = n — 1 to begin with. However, since G\ has 
at least two orbits, we have by orbit counting lemma that IE g eGi [ move (fl')] < 
n — 2. Hence, for some coset G\gi of G\ in G we must have E 9g G l9i [move(ggi)] > 
n— 1. The polynomial-time algorithm of Theorem 12 . 5 1 applied to G will therefore 
continue the search in cosets where the expected value is strictly more than n — 1 
which means that it will finally compute a fixed point free element of G. □ 

Given G = (S) < S n there is a trivial exponential time algorithm for finding 
a fixed point free element in G: compute a strong generating set for G in 
polynomial time |Sim70| . Then enumerate G in time IGl.n ^ 1 ) using the strong 
generating set, checking for a fixed point free element. This algorithm could 
have running time n\ for large G. We next describe a 2 n n°^ time algorithm 
for finding a fixed point free element based on inclusion-exclusion and coset 
intersection. 

Theorem 2.7. Given a permutation group G = (S) < S n and tt e S n there is 
a 2"+0( v /"ign) n O(i) n me algorithm to test if the coset Gir has a fixed point free 
element and if so compute it. 

Proof. For each subset A C [n] we can compute the pointwise stabilizer sub- 
group Ga- This will take time 2 n n°^ overall. For each i E [n], let (G7r)j 
denote the subcoset of Gir that fixes i. Indeed, 

(Gvr)i = { g7 r \ g £ G,gn(i) = i} = G^nn, 
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if there is a Tj € G such that Tj(7r(z)) = i and (Gir)i = otherwise. 

Clearly, G-7T has a fixed point free element if and only if the union IJILi (Gir)i 
is a proper subset of Gir. I.e. we need to check if |ljr=i(^ 7r )*l < l^l = 1^1- 
Now, | UiLi^ 71 ")*! can ^ e computed in 2 n + (v / ™ig™) n O(i) ^j me us i n g th e inclu- 
sion exclusion principle: there are 2 n terms in the inclusion-exclusion formula. 
Each term is the cardinality of a coset intersection of the form (\^j(G^)i, for 
some subset of indices I C [n], which can be computed in time n ^^^ time 
|BKL83| . Hence, we can decide in 2 n+0 (v / " 1 g n ) n O(i) ^ me wne ther or not Gir 
has a fixed point free element. Notice that this fixed point free element must be 
in one of the n — 1 subcosets of Gir that maps 1 to j for j 6 {2, 3, . . . , n}. The 
subcoset of Gir mapping 1 to j can be computed in polynomial time |Sim70] . 
Then we can apply the inclusion exclusion principle to each of these subcosets, 
as explained above, to check if it contains a fixed point free element and continue 
the search in such a subcoset. Proceeding thus for n — 1 steps we will obtain a 
fixed point free element in Gir, if it exists, in 2 n+0 (v / " 1 s n ) n °( 1 ) time. □ 

We now prove the main result of this section. 

Theorem 2.8. There is a deterministic 2 2k+0{ -^ l ^k° w + n° (1) time al- 
gorithm for the k-MOVE problem and hence the problem is fixed parameter 
tractable. Furthermore, if G = {S) < S n is a "yes" instance the algorithm 
computes a g G G such that move (g) > k. 

Proof. Let G = (S) < S n be an input instance of fe-MOVE with parameter k. 
By Equation [2] we know that E 5e c[move(g) > move(G)/2. We first compute 
move(G) in polynomial time by computing the orbits of G. If move(G) > 2k 
then the input is a "yes" instance to the problem and we can apply Theorem [23] 
to compute a g G G such that move(g) > k in polynomial time. Otherwise, 
move(G) < 2k. In that case, the group G is effectively a permutation group on 
a set fi C [n] of size at most 2k. For each subset A C 17 of size at most k, we 
compute the pointwise stabilizer subgroup Ga of G in polynomial time [Sim70| . 
This will take overall 2 2k n°^ time. Now, if the input is a "yes" instance to 
A;-MOVE, some subgroup Ga must contain a fixed point free element (i.e. fixed 
point free in O \ A). We can apply the algorithm of Theorem 12.71 to compute 
this element in time 2 2k+0 ^ l ^k°^ . □ 

Remark. We note from the first few lines in the proof of Theorem 12.81 that 
the application of Theorem 12.51 is actually a polynomial time reduction from 
the given /c-MOVE instance to an instance for which move(G) < 2k. Given 
G = {S} < S n such that move(G) < 2k, note that G is effectively a subgroup of 
5*2fc- We can apply the Schreier-Sims algorithm to compute from S a generating 
set of size 0(k 2 ) for G, therefore yielding a polynomial time computable, k°^ 
size kernel (see [FG06] for definition) for the /c-MOVE problem. 

3 The parameterized minimum base problem 

In this section we turn to another basic algorithmic problem on permutation 
groups. 
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Definition 3.1. Let G < S n be a permutation group. A subset of points B C [n] 
is called a base if the pointwise stabilizer subgroup Gb of G (subgroup of G that 
fixes B pointwise) is the identity. 

Since permutation groups with a small base have fast algorithms for various 
problems [Ser03] . computing a minimum cardinality base for G is very useful. 
The decision problem is NP-complete. On the other hand, it has a lglgn factor 
approximation algorithm [B192] . 

In this section we study the parameterized version of the problem with base 
size as parameter. We are unable to resolve if the general case is FPT or not, 
we give FPT algorithms in the case of cyclic permutation groups and for per- 
mutation groups with orbits of size bounded by a constant. 

fc-BASE Problem 

INPUT: A permutation group G = (S) < S n given by generators and a number 
k. 

PROBLEM: Is there a base of size at most k for G. The search version is the 
find such a base. 

A trivial n k+ °^ algorithm would cycle through all candidate subsets B of 
size at most k checking if Gb is the identity. 

Remark. If the elements of the group G < S n are explicitly listed, then the 
fc-BASE problem is essentially a hitting set problem, where the hitting set B 
has to intersect, for each g G G, the subset of points moved by g. However, the 
group structure makes it different from the general hitting set problem and we 
do not know how to exploit it algorithmically in the general case. 

3.1 Cyclic Permutation Groups 

We give an FPT algorithm for the special case when the input permutation 
group G = (S) is cyclic. While this is only a special case, we note that the 
minimum base problem is NP-hard even for cyclic permutation groups [B1921 
Theorem 3.1]. 

Theorem 3.2. The k— BASE problem for cyclic permutation groups is fixed 
parameter tractable. 

Proof. Let G = (S) < S n be a cyclic permutation group as instance for /c-BASE. 
Using known polynomial-time algorithms |Sim70l ILuk93] we can compute a 
decomposition of G into a direct product of cyclic groups of prime power order. 

G = i?i x # 2 x ... x H e 

where each Hi is cyclic of prime power order. Let Hi = {gi), where the order 
of gi, o(gi) = p^, I < i < £, where the p^s are all distinct. Notice that 
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\G\ = P^P^ 2 ■ ■ -PT- We can assume \G\ < n k , Otherwise, G does not have a 
size k base and the algorithm can reject the instance. Since 

(£/e) e <i\ <pi P2 ---pe <n k , 
it follows that £ = 0($|£). 

For each gi, when we express it as a product of disjoint cycles then the 
length of each such cycle is a power of pi that divides p^' , and there is at least 
one cycle of length p^' . Clearly, any base for G must include at least one point 
of some p^-cycle (i.e. cycle of length p^) of gi, for each i. Otherwise, the cyclic 
subgroup Hi of G will not become identity when the points in the base are 
fixed. For each index i : 1 < i < I, define the set of points 

Si = {a € [n] | a is in some pf* cycle of gi}. 

Claim. Let B C [n] be a subset of size k. Then B is a base for G if and only 
if B is a hitting set for the collection of sets {Si, 5*2, ... , Sf\. 

Proof of Claim. Clearly, it is a necessary condition. Conversely, suppose 
\B\ = k and B n Si 7^ for each i. Consider the partition of [n] into the orbits 
of G: 

[n] = tti U $7 2 U • • • U tt r . 

For each gi, a cycle of length p^ in gi is wholly contained in some orbit of 
G. Indeed, each orbit of G must be a union of a subset of cycles of gi. Since 
B n Si 7^ 0, some p^-cycle Cj of gi will intersect B. 

Assume, contrary to the claim, that there is a g £ Gb such that g 7^ 1. We 
can write g = g^g^ 2 ■ ■ ■ 9^ e for nonnegative integers < p\\ Suppose g^ J 7^ 1. 
Then raising both sides of the equation g = g^g^ 2 ■ ■ ■ g\ l to the power ^jl, we 
have 

M 

9 =9 3 = 9j \ 

where /3~ < p e / . Moreover, /3 7 - = ^ G ]° J (mod p e - J ) is nonzero because a 7 - 7^ 

^3 

0(mod Pa 3 ) and \G\/pj 3 does not have pj as factor. 

By assumption, some jy 1 -cycle Cj of gj intersects B. Since /3j is nonzero 

e • S • 

and strictly smaller than p? , none of the points of Cj are fixed by g - J which 
contradicts the assumption that g and hence g' is in Gb- This proves the claim. 

We now explain the FPT algorithm. If |G| > n k then there is no base of size 
k. Hence we can assume |G| < n k . As already observed, t = 0( igi|" )• Thus, 
we need to solve the k- hitting set problem for a collection of at most Q( igig" ) 
many sets {Si, S2, ■ ■ ■ , Si}. We can think of it as a problem of fe-coloring the 
indices {1,2,..., £} such that for each color class / we have r\ e jiSj 7^ and we 
can pick any one point for each such intersection. Notice that there are at most 

kr = n's'g" many such colorings. Now, if fclg k < lglgn this number is bounded 
by can we can cycle through all these /c-colorings in polynomial time and 
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find a good /c-coloring if it exists. On the other hand, if k lg k > lg lg n then 
n k < 2 k +1 which means the brute force search gives an FPT time bound. □ 

3.2 Bounded Orbit Permutation Groups 

We give an FPT algorithm for another special case of the fc-BASE problem: 
Let G = (S) < S n such that G has orbits of size bounded by a fixed constant b. 
I.e. [n] = bj™ 1 where |f2j| < b for each i. This is again an interesting special 
case as the minimum base problem is NP-hard even for orbits of size bounded 
by 8 [Bl92l Theorem 3.2]. 

Suppose G has a base B = {ix, 12, ■ ■ ■ , ik} of size k. Then G has a pointwise 
stabilizer tower G = Go > G\ > . . . > Gk = {1} obtained by successively fixing 
the points of B. More precisely, Gj is the subgroup of G that pointwise fixes 
{ii,i2, ■ ■ ■ Now, -jQ-y * s * ne or bit size of the point ij in the group Gj-\. 
Furthermore, b is also a bound on this orbit size. Therefore, \G\ < b k . Hence 
in b k n°^ time we can list all elements of G. Let G = {gi,<72; • • • ,9n}, where 
N < b k , where g± is the identity element. 

For each gi G G, i > 2, let Si = {j € [n] \ gi(j) 7^ j} denote the nonempty 
subset of points not fixed by gi. Then a subset B C [n] of size k is a base for 
G if and only if B is a hitting set for the collection S%, S3, ... , 5jv- The next 
claim is straightforward. 

Claim. There is a size k hitting set contained in [n] for the sets {S2, S3 ... , Sn} 
if and only if there is a partition of {2, 3, . . . , iV} into k parts I\, I2, ■ ■ ■ , Ik such 
that rij e i r Sj ^ for each r = 1, 2, . . . , k. 

As N < b k , the total number of ^-partitions of {2, 3, . . . , N} is bounded by 
k N < k b \ We can generate them and check if any one of them yields a hitting 
set of size k by checking the condition in the above claim. The overall time 
taken by the algorithm is given by the FPT time bound fc b *n° (1) . We have 
shown the following result. 

Theorem 3.3. Let G = {S} < S n such that G has orbits of size bounded by b, 
be an instance for the k-BASE problem with k as parameter. Then the problem 
has an FPT algorithm of running time k b . 

4 Concluding Remarks 

The impact of parameterized complexity on algorithmic graph theory research, 
especially its interplay with graph minor theory, has been very fruitful in the 
last two decades. This motivates the study of parameterized complexity ques- 
tions in other algorithmic problem domains like, for example, group-theoretic 
computation. To this end, we considered parameterized versions of two well- 
known classical problems on permutation groups. We believe that a similar 
study of other permutation group problems can be a worthwhile direction. 
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